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The jamming transition of particles with finite-range interactions is characterized by a variety of 
critical phenomena, including power law distributions of marginal contacts. We numerically study 
a recently proposed simple model of jamming, which is conjectured to lie in the same universality 
class as the jamming of spheres in all dimensions. We extract numerical estimates of the critical 
exponents, 9 = 0.451 ± 0.006 and 7 = 0.404 ± 0.004, that match the exponents observed in sphere 
packing systems. We analyze finite-size scaling effects that manifest in a subcritical cutoff regime and 
size-independent, but protocol-dependent scaling curves. Our results supports the conjectured link 
with sphere jamming, provide more precise measurements of the critical exponents than previously 
reported, and shed light on the Hnite-size scaling behavior of continuous constraint satisfiability 
transitions. 


Jamming is the continuous emergence of nonzero me¬ 
chanical moduli i n a system of particles with finite- 
range interactions [BBB+lll ITSlOl lOLLNO^ . The en¬ 
semble of configurations at the transition boundary ex¬ 
hibits many dramatic phenomena, including anomalous 
vibration spectra [WNWOfil IParldl IFPUZ15] , isostatic- 
ity and hyperuniformity [ZJT11| . critical scaling of me¬ 
chanical moduli [vH09) . and power-law distributions of 
the weakest forces and the smallest interparticle gaps 
[CCPZl^ IFP151IKMT13) . The jamming transition can 
be understood as a continuous analog of the satisfiabil¬ 
ity transition in random constraint satisfaction problems 
[FP15| . usually studied in the discrete setting [PIM06| . 
Recently the transition in a simple constraint problem, 
the perceptron, was conjectured to lie in the same univer¬ 
sality class as the sphere jamming transition in all spatial 
dimensions [FP15) . Here we numerically study the per¬ 
ceptron and show that the power law exponents match 
those measured numerically for sphere jamming, but may 
not match the theoretically predicted exponents. We em¬ 
ploy finite-size scaling to extract precise measurements of 
the exponents and demonstrate the universal critical be¬ 
havior of the system. Our results support the conjecture 
linking the perceptron to sphere jamming, and provide 
more precise numerical estimates of the jamming critical 
exponents than previously reported. 

The jamming ensemble corresponds to the random 
packing conhgurations of nonoverlapping hard spheres 
such that no improvement in the packing density is pos¬ 
sible by local movement of the spheres. As such, it is a 
local transition between the satisfiability of the nonover¬ 
lap constraints at lower density, and unsatisfiabily of all 
constraints simultaneously at higher density. This transi¬ 
tion for equal-sized three-dimensional spheres occurs typ¬ 
ically at a range of densities around 64% depending on 
preparation protocol |CBS10| . The restriction to random 
packing is crucial, since the constraints are simultane¬ 
ously satisfiable all the way to the close packing density 
of spheres, 74%. As a result, any theoretical treatment 
of the jamming transition must overcome the problem of 
excluding configurations with crystalline order from the 
phase space. One approach that has been successful in 


reproducing the metastable disordered phase behavior of 
systems with a thermodynamically stable ordered phase 
has been to construct systems with quenched disordered 
that exhibit the same correlation structure in the disor¬ 
dered phase |MPR94] . 

The perceptron model, well known in machine learn¬ 
ing |Ros58) ■ when extended to its nonconvex regime, 
has been shown by Franz and Parisi to be solved by 
the same replica symmetry breaking (RSB) ansatz as 
that occurring as a solution for the jamming point in 
a model of sphere packing i n the limi t of an infinite num¬ 
ber of dimensions |FP151 ICKP+ll] . It is conjectured 
that the jamming transitions of spheres in all dimensions 
lie in the same universality class as these two models 
|(X1PZ121 ICKP+M) . Here,' we numerically simulate the 
perceptron model and compare our numerical results to 
numerical simulations of sphere jamming and the theo¬ 
retical predictions of the RSB solution. 

For a given size n and number of constraints m, an 
instance of the perceptron is given by the following con¬ 
strained optimization problem: 

maximize F(x) = ||x||^ = (x,x) 
subject to X e M" (1) 

(C/i: x) < 1 for all /r = 1,..., m, 

where p, = 1,..., m, are independently drawn from 
a uniform distribution over the unit sphere 5”“^. To 
approach the thermodynamic limit, the system size n is 
increased toward infinity while the ratio a = m/n is held 
constant |FP15| . 

An equivalent formulation, closer to the traditional set¬ 
ting of the perceptron model is obtained by restricting x 
to 5'"“^ and maximizing the distance from the nearest 
point However, the formulation |(1)| allows all the 
constraints to be linear inequality constraints. Thus, the 
only nonlinearity, distinguishing m from a linear pro¬ 
gram (LP), is in the objective function. Moreover, since 
the objective is convex, the local maxima occur at ver¬ 
tices of the feasible polytope, so the number of active 
constraints (constraints satisfied with equality) must be 
at least n. (It can also be no greater than n due to 
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FIG. 1. Mean values of the smallest force (solid line) and of 
the smallest slack (dashed line) in the locally optimal solutions 
reached by the sequential LP protocol in random instances of 
the perceptron as a function of system size. The lines show the 
power-law fit to the data, from which we extract the numerical 
exponent estimates: Q = 0.451 ±0.006 and 7 = 0.404±0.004. 


the genericity of the constraints). In these properties, 
the model is reminiscent of an earlier jamming model, 
namely the jamming transition of lattice sphere packing 
[KMTI 3 I IKT14) . In this model, the determinant of a 
symmetric d x d matrix Q is minimized, subject to the 
linear constraints (^, Q^) > 1 for all ^ S Whereas 
the perceptron model has quenched disorder, the sphere 
packing and lattice packing models do not and have an 
ordered phase in addition to the disordered phase. 

One of the remarkable properties of the jamming en¬ 
semble observed in sphere jamming is the power law dis¬ 
tribution of very weak contact forces and of very small 
interparticle gaps. In the context of general constrained 
optimization problems, these correspond to the distribu¬ 
tion of Lagrange (or Karush-Kuhn-Tucker) multipliers 
associated with active inequality constraints and the dis¬ 
tribution of slacks of inactive constraints (the difference 
between the two sides of an inequality constraint). The 
constraints at the low end of each of these distributions 
can be thought of as the marginal constraints: the active 
constraints closest to becoming inactive and vice versa. 
The observation of power law distributions of marginal 
constraints has been explained heuristically as resulting 
from the marginal stability of typical jammed configura¬ 
tion |WyaI2| : in order for the configuration to be stable, 
it must either exhibit a suppression of weak active con¬ 
straints, which contribute to instability, or an enhance¬ 
ment of small-slack inactive constraints, which contribute 
to stability, or both, as is observed. A quantitative ver¬ 
sion of this argument gives a predicted relation between 
the exponents of the two power laws. 

At a locally optimal feasible point of |(I)[ standard re¬ 
sults in nonlinear optimization imply the existence of La- 
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FIG. 2. Gritical exponent values inferred from the average 
slopes of the curves of [Figure 1| measured between between n 
and 2n. The horizontal lines are the theoretically predicted 
values. No clear trend signaling corrections to finite-size scal¬ 
ing is apparent. 

grange multipliers (forces) /^, such that /^ > 0 if and 
only if x) = 1, and x = ||x||n"i /2 It is pre¬ 

dicted that in the thermodynamic limit, the distribution 
of forces satisfies a power law p{f) ~ with a universal 
exponent 9 = 0.42311 for small / [FP15] . In particu¬ 
lar, the smallest force is of the order of the value /min 
such that p{f)df -- That is, /min ^ 

For finite systems, we expect the distribution to follow 
the power law only in the range ^ / ^ 1 . 

However, as in other universal critical points, we expect 
a finite-size scaling behavior even for moderately sized 
finite systems. In particular, we expect, when / <C 1, 

p(/)=n-^/(i+«)/(/ni/(i+«)). ( 2 ) 

We are also interested in the distribution of slacks of 
inactive constraints. Let x))/|lx|l and 

let ng{r)dr be the expected number of constraints p such 
that 0 < r < < r ± dr. The theoretically predicted 

distribution for small r in the thermodynamic limit is 
g{r) ~ r~'^, and consequently the smallest nonzero slack 
should scale with system size as rmin ~ n -i/(i-7) [FPlb) . 
The theoretically predicted universal value for the expo¬ 
nent is 7 = 0.41269 |FP15) . For finite systems, the power 
law should be cut off around rmin consistent with a finite- 
size scaling function 

g{r) = . (3) 

The marginal stability heuristic predicts that 7 = l/(2± 
9), a relationship that is satisfied by the theoretically 
predicted values |Wyal2[ IFP15| . 

We perform numerical optimization of the perceptron 
at a constraint ratio a = 4 and sizes n = 200, 300, 400, 
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FIG. 3. Empirical distributions (left) of slacks of inactive constraints (top) and Lagrange multipliers of active constraints 
(bottom) at the jamming point. The middle and right panels show the finite-size scaling collapse of the distributions using the 
numerically extracted exponents and the theoretically predicted exponents respectively. 


600, 800, 1200, 1600, and 2400. We generate 10®, 10®, 
10®, 10®, 10®, 5 • 10^ 2 • 10^ and 2 • 10^ independent 
realizations, respectively, of each size. The optimization 
protocol solves a sequence of LPs that are identical to |(l)[ 
except that the objective is replaced by a linear objective 
P)(x) = (yt,x). The objective vector for each step is 
given by the solution of the previous LP: yt+i = x°^*. 
The real objective ||x|p necessarily increases at each step 
and the process converges to a local optimum of m in 
finitely many steps. 

In Figure 1 we plot the mean value of the smallest 
force (/min) and the mean value of the smallest slack 
{fmin) as functions of the system size. In both cases, we 
obtain a power-law fit as predicted. The inferred val¬ 
ues of the critical exponents are 7 = 0.404 ± 0.004 and 
6 = 0.451 ± 0.006. The inferred values are close to the 
theoretically predicted values, but do not seem to include 
the latter in their confidence regions. Still, the inferred 
values satisfy the marginality relation 7 = 1/(2 -b 0 ). 

It is possible that corrections to finite-size scaling are 
responsible for the discrepancy between our numerically- 
inferred exponents and the theoretical values and that 
the apparent exponents at finite n are different from their 
limit as n —>■ 00 . We measure the local slopes of the 
curves of [Figure 1 and we do not observe a clear trend 


in 7 (n) or 0{n), which would be indicative of corrections 
to finite-size scaling (see Figure 2). Still, partly due to the 
increase in the error estimate, the slope values at larger 
sizes seem to be more consistent with the theoretically 
predicted exponents. Another explanation could be that 
the thermodynamic calculation predicting the exponent 
values only approximately applies to the setting at hand, 
which employs a highly off-equilibrium hill-climbing dy¬ 
namic. 


Previous numerical studies of systems conjectured to 
be in the same universality class provide similar estimates 
of the critical exponents. Studying hard and soft spheres 
in up to 10 dimensions, the authors of Ref. |CCPZ12] find 
7 « 0.39 for soft spheres, and 7 « 0.42 for hard spheres. 
In finite-dimensional sphere packings, the distribution of 
contact forces has additional contributions due to local¬ 
ized modes that dominates at low forces, bnt the relevant 
exponent 9e can be extracted by looking only at contacts 
coupled to extended modes [LDW131ICCPZ15] . In Ref. 
[LDW13| . the authors measure 7 « 0.38 and Of. « 0.44 
for hard spheres in 3 dimensions. In Ref. |DLB W 14] . the 
authors measure 7 « 0.4 and de « 0.44 for hard spheres 
in 2 and 3 dimensions. These values closely agree with 
our estimates of the critical exponents in the perceptron. 
Since we approach the transition from the satisfiable side. 
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FIG. 4. Finite-size scaling collapse for jamming points of 
the edge-climbing and edge-jumping protocols. The two sets 
of data collapse to a common curve in the critical regime, but 
to two separate scaling curves in the subcritical regime. 


our results should be considered analogous to the hard 
sphere results. 


We now turn t o inspecti ng the distributions g{r) and 
p{f) presented in Figure 3 As the system size increases, 
a clear power law develops extending to lower and lower 
values of r and /. However, at each finite size, the power 
law is cut off and approaches a constant as r, / —)■ 0. The 
finite nonzero values of g{0) and p( 0 ), are of particular 
interest. Observation of such cutoffs have previously been 
cited as evidence against the existence of a p ower law 
(or for trivial exponents 7 = 0 = 0) |DTS051 lTSS~*~05l 
ITSVvHiOl IKT141IBMSM14] , but in the current context 
can be understood as finite-size effects. 


The region controlled entirely by the power law ap¬ 
pears to be no more than two decades of magnitude at 
the largest system size for each distribution. Therefore, 
even when we use the steepest decade of data at the 
largest system size to fit a power law, we obtain ex¬ 
ponent estimates significantly lower than the ones in¬ 
ferred by comparing different system sizes: 7 « 0.37 and 
6 « 0.42. The shallower behavior in the cutoff regimes 
affects the curve significantly even dacades away from 
the overt crossover. This appears to not be the case for 
sphere jamming, where the sparsity of the constraints in 
comparison with the number of degrees of freedom seems 
to allow the efficient simulation of much larger systems, 
where the power-law regime spans 3-4 decades. Even in 
that case, the subcritical and supercritical regimes could 
still have an effect on the apparent power-law exponents. 


Studying the finite-size scaling of the distribution could 
provide a useful comparison. _ 

W e can test the finite-size scaling hypotheses, m and 
m by appropriately rescaling the axes by the appropri¬ 
ate powers of n. When we use our inferred exponent val¬ 
ues to rescale the data (see [Figure 3 ), they collapse to a 
size-independent curve, with a common behavior in the 
critical and subcritical regimes. The theoretically pre¬ 
dicted exponent values give a slightly, but visibly, poorer 
collapse, especially for the distribution of slacks. 

While the scaling curve appears to be size indepen¬ 
dent, we do observe striking protocol dependence: in ad¬ 
dition to the sequential LP protocol described above, we 
implemented two additional protocols at smaller sizes. 
The edge-climbing (EC) protocol mimics the simplex al¬ 
gorithm of linear programming, starting at a vertex of 
the feasible region and traveling at each step to an adja¬ 
cent vertex along the edge offering the largest directional 
derivative of the objective. When all such derivatives are 
negative, a local optimum is achieved and the protocol 
terminates. The edge-jumping (EJ) protocol makes EC 
moves when they are available, but otherwise tries each 
edge and follows it if the objective value at the other end¬ 
point is larger. If neither type of move is available, the 
protocol terminates. 

We see an overt difference in the distribution of forces 


at the jamming point achieved by the two protocols (Fig¬ 


ure 41. While p{f) shows similar behaviors in the power 
law regime, below the cutoff we observe p{f) ~ constant 
in the EC protocol, and p{f) ^ / in the EJ protocol. 
The edge-jumping moves destabilize weak constraints 
and suppress the subcritical regime of the force distri¬ 
bution in a nonuniversal way, clearly distinguished from 
the universal critical suppression. 

The perceptron model provides a numerically tractable 
setting in which to test many of the theoretical ideas and 
methods about the jamming transition. Finite-size ef¬ 
fects studied here could be crucial to applying these ideas 
to real-world problems away form the thermodynamic 
limit. In the present case at least, comparison of systems 
of different sizes provides a more sensitive measure of the 
critical exponents, which are distorted by finite-size ef¬ 
fects in any single size studied here. Our estimates of the 
critical exponents match those measured numerically in 
sphere jamming systems, supporting the conjecture that 
they are in the same universality class. However, we 
observe some variance from the theoretically predicted 
exponent values, both in the scaling of the minimal force 
and minimal slack with system size, and in the finite-size 
scaling collapse. Finally, we observe size-independent but 
protocol-dependent finite-size scaling curves that demon¬ 
strate distinct critical and subcritical behavior. 
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